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SMALL FORM FACTOR LIQUID LOOP COOLING SYSTEM 

The present invention relates generally to multi-tiered, modular rack systems 
for components and, more particularly, to a cooling system for cooling components 
in a small form factor chassis mounted in a standardized system rack. 



BACKGROUND OF THE INVENTION 

Multi-tiered, modular racks are commonly used with groups of modular 
chassis. Such racks commonly provide each chassis with access to network 
connections and electrical power. A typical chassis might contain components and 
interconnecting devices (e.g., printed circuit board cards and wires) that form a 
computer system such as a server. Each chassis functions to provide an 
environment relatively free from excessive heat, shock, vibration and/or dust for the 
computer system. Groups of these computer systems are interconnected to form 
electronic applications, such as server farms that serve the networking needs of 
large organizations. 

In present-day, standardized racks, 1U "pizza-box" chassis (being 
approximately 1.7 inches tall, and various lateral sizes such as 19 by 24 inches), 
each housing a separate computer having one or more CPUs, are found to be useful. 
In particular, the small form factor (i.e., size) allows for a large number of 
computers to be vertically stacked, with up to around 40U or 42U, in each rack. 
The modular nature of each such chassis allows for a given computer system to be 
swapped out of the network and the rack without interfering with the operation of 
other computer systems. 
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Each chassis typically has one or more air movers (e.g., fans) that pump 
ambient air through the chassis to absorb heat from the components, or from heat 
sinks attached to the components. In response to demands for networks of high- 
performance computer systems, components are being designed with increased 

5 cooling requirements, and printed circuit boards are being designed with increased 
component densities. Managing these increased heat-dissipation requirements is 
complicated by the limited size of the 1U chassis. In particular, the small form 
factor limits both the available fan sizes and the space for air to flow through the 
chassis. The limited space typically includes many impediments, such as heat 

10 sinks, wires and components, causing significant airflow impedance. As a result, 
the airflow through the chassis can be significantly limited, thereby limiting the 
dissipation ability of the chassis cooling system. Furthermore, the tight space 
configuration can create cooling issues such as hot spots, dead zones and/or 
insufficient cooling capacity in particular chassis locations. 

15 

It will therefore be appreciated that there is a need for a cooling system and 
apparatus for effectively cooling the heat-dissipating components housed within a 
1U chassis in multi-tiered, modular racks. There is also a need for a resulting 
modular rack system. Preferred embodiments of the present invention satisfy some 
20 or all of these needs, and provide further related advantages. 

SUMMARY OF THE INVENTION 

25 In various embodiments, the present invention may solve some or all of the 

needs identified above, providing a rack-mounted 1U chassis having a cooling 
system configured to cool components. More particularly, the invention provides 
a modular computer system for mounting in a multi-tiered support. The computer 
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system includes a computer chassis configured for mounting in the multi-tiered 
support, and one or more computer components within the computer chassis. 

To cool the one or more components, the computer system includes a fluid- 
cooled cold plate, a heat exchanger and an air mover. The cold plate is in thermal 
communication with the one or more computer components, and is configured to 
dissipate heat from the one or more components by convectively removing the heat 
into a stream of liquid coolant, which stays in the liquid state. The heat exchanger 
is in turn configured to dissipate heat from the liquid coolant routing the cooled 
liquid coolant back to the cold plate. The air mover is configured to cool the heat 
exchanger. In many embodiments, the air mover is further configured such that the 
air cooling the heat exchanger also cools most or all the components that are not 
cooled by the cold plates. 

As described below, embodiments of the invention can include additional 
features that will provide various advantages in some configurations. One or more 
small, mechanical coolant pumps may be used to circulate the coolant around the 
cooling system. The coolant, the cold plates, the heat exchanger, the pump(s) and 
the connecting tubes may form a closed-loop cooling system that cools each 
component having high heat-dissipation requirements. A pump could be located 
in numerous positions along the liquid loop. 

Additionally, the computer system may feature a thin, 1U or 2U chassis. The 
air mover may extend across an intermediate portion of the chassis, and be 
configured to draw air through the heat exchanger, while blowing air onto other 
components and out chassis exhaust vents. Alternatively, the air mover can be 
configured such that it is located by the power supply, and so that it blows 
crosswise within the chassis, with respect to an outlet ventilation direction. Various 
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aspects of these features can often provide for efficient use of space and power, as 
well as providing reliability benefits, while being usable with computer systems 
conforming to typical industry server configurations. 

Other features and advantages ofthe invention will become apparent from 
the following detailed description ofthe preferred embodiments, taken with the 
accompanying drawings, which illustrate, by way of example, the principles ofthe 
invention. The detailed description of particular preferred embodiments, as set out 
below to enable one to build and use an embodiment of the invention, are not 
intended to limit the enumerated claims, but rather, they are intended to serve as 
particular examples ofthe claimed invention. 



BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a perspective view of a multi-tiered modular rack, with a removed 
modular chassis, embodying the invention. 

FIG. 2 is a top view ofthe removed chassis depicted in FIG. 1. 

FIG. 3 is a perspective, cutaway view ofthe removed chassis depicted in 
FIG. 1. 

FIG. 4 is a front, cross sectional view ofthe removed chassis depicted in 
FIG. 1 , taken along line 4-4 of FIG. 3. 



FIG. 5 is a front view of a CPU and an cold plate contained in the 
chassis depicted in FIG. 1 . 
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FIG. 6 is a top view of a cooling system contained in the removed chassis 
depicted in FIG. 1. 

FIG. 7 is a top view of a cooling system, contained in a variation of the 
removed chassis depicted in FIG. 1 . 

FIG. 8 is a top view of a second embodiment of the removed modular chassis 
depicted in FIG. 1 . 

FIG. 9 is a top view of a variation of the embodiment depicted in FIG. 8. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The invention summarized above and defined by the enumerated claims may 
be better understood by referring to the following detailed description, which 
should be read with the accompanying drawings. This detailed description of 
particular preferred embodiments of the invention, set out below to enable one to 
build and use particular implementations of the invention, is not intended to limit 
the enumerated claims, but rather, it is intended to provide particular examples of 
them. 

Typical embodiments of the present invention reside in atiered apparatus for 
supporting, cooling, and connecting or interconnecting a plurality of thin, stackable 
computer chassis. The tiered apparatus is typically in the form of a multi-tiered 
modular rack, which can optionally be configured with wiring such that the 
computer chassis receive power, and interconnect to form networked computer 
systems or other electronic devices. 
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With reference to FIG. 1, a first embodiment of the present invention is an 
apparatus forming a tiered structure. More particularly, the embodiment includes 
a multi-tiered support that is configured to hold a plurality of computer chassis 101. 
Preferably the multi-tiered support is a conventional modular rack 103 configured 
for a plurality of 1U servers. 

The chassis 101 are stacked in a tier-stacking dimension, which will be 
referred to as a longitudinal dimension 105. The longitudinal dimension extends 
between two ends of the stack, a top end 107 and a bottom end 109. In addition to 
the top and bottom ends, the tiered structure includes four lateral sides: a front side 
1 1 1 and opposite rear side, and a left side 1 13 and opposite right side. 

With reference to FIGS. 1-4, similar to the modular rack 103, each chassis 
101 has opposite longitudinal ends, atop end 121 and abottom end 123, along (and 
with respect to) the longitudinal dimension 105. Each chassis also has a front side 
125, a rear side 127, a right side 129 and a left side 131, each chassis side and end 
corresponding to the similarly named sides and ends of the modular rack when the 
chassis is mounted in the rack. Preferably each chassis is a thin chassis (i.e., thin 
along the longitudinal dimension 105), typically being a 1U rackmount chassis (i.e., 
being 1U in height and configured to fit in a standard rack), or alternatively ranging 
in size up to 2U in height. 

Each chassis 101 is configured with a printed circuit board ("PCB") bottom 
panel 141 to support and/or interconnect one or more electronic assemblies, 
including a floppy drive 143, a CD and/or DVD drive 145, a plurality of hard disk 
drives 147, a power supply 149, memory cards 151, input/output ("I/O") units 1 53, 
a plurality of central processor units ("CPUs") 155 having high heat-dissipation 
requirements, other high-dissipation components 157, and some moderate heat- 
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dissipation components 159 (i.e., having moderate heat-dissipation requirements), 
which may be fitted with heat sinks 161. The power supply adjoins the right and 
rear sides of the chassis 1 0 1 . The bottom panel is preferably a printed circuit board 
wired to interconnect the electronic assemblies to form a computer configured for 
use as a network server, an application-specific thin server, or the like. 

The chassis and modular rack are configured to provide an environment 
relatively free from excessive shock, vibration and/or dust. In particular, the chassis 
bottom panel 141, front side 125, rear side 127, right side 129 and left side 131 
form five sides of a controlled chassis chamber containing the electronic 
assemblies. The sixth side may be formed by an additional chassis panel, a panel 
in the modular rack, or by a bottom panel of a neighboring chassis contiguous with 
the top end 121 of the chassis 101. 

The chassis and its electronic assemblies are also configured with a cooling 
system to dissipate heat from the electronic assemblies requiring heat dissipation. 
More particularly, the chassis front side 125 defines intake air vents 171, and the 
chassis rear side 127 defines exhaust air vents 173. An air mover including a bank 
of chamber fans 175 extends laterally, substantially across the chassis chamber 
between the chassis left side 131 and the power supply 149. Additionally, the 
power supply 149 has dedicated intake fans 177 and exhaust fans 179. The power 
supply intake fans are roughly aligned (laterally) with the bank of chamber fans (as 
seen in FIG. 2). All of the fans, including the chamber fans, the power supply 
intake fans and the power supply exhaust fans, blow in a rearward direction. 
Optionally, the air mover can extend fully across the chassis, and optionally include 
some of the power supply fans, such as the dedicated intake fans 177. 
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The power supply is fully enclosed such that the dedicated intake fans 177 
and exhaust fans 179 control and direct all the cooling airflow entering and exiting 
the power supply. The intake fans 177 draw air from within the chassis chamber, 
and the exhaust fans 179 blow air from within the power supply directly through 
vents in the rear side 127 of the chassis, thus preventing the hot air from the power 
supply from reaching other portions of the chassis. 

The bank of chamber fans 175 and the power supply divide the chassis 
chamber such that, excluding the power supply, the chassis chamber forms two 
chambers, an upstream chamber 1 81 and a downstream chamber 1 83. The bank of 
chamber fans 175 draws air from the upstream chamber and blows it into the 
downstream chamber, thereby forcing air in the upstream chamber to flow through 
the downstream chamber and out the exhaust vents 173. 

The suckion of the chamber fans draws outside air into the upstream chamber 
through the intake air vents 1 71, and possibly through the floppy drive 143, the CD 
and/or DVD drive 145, and the plurality of hard disk drives 147. This outside air 
can provide some heat dissipation to the floppy drive 143, the CD and/or DVD 
drive 145, and the plurality of hard disk drives 147. 

While some air may flow backward from the downstream chamber to the 
upstream chamber, a significant amount of air in the downstream chamber is 
exhausted out the exhaust air vents 173, thus transferring the heat removed from the 
liquid stream to a location outside of the chassis. Optionally, the upstream chamber 
and downstream chamber can be separated by flow guides or a partition to prevent 
air from flowing back from the downstream chamber to the upstream chamber. 
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With reference to FIGS. 4-6, the chassis cooling system includes a first cold 
plate 201, a second cold plate 203 and a third cold plate 205. The first and third 
cold plates, 201 and 205, are each affixed to one of the CPUs 1 55, and the second 
cold plate 203 is affixed to the other high-dissipation component 1 57, thus all three 
cold plates are affixed to components having high heat-dissipation requirements. 
The cold plates are affixed in a manner placing them in thermal communication 
with their respective components so that they can dissipate heat from the 
components. 

The cold plates may be any of a variety of types wherein a stream of liquid 
coolant flowing through the cold plate is used to absorb heat, and the resulting 
heated liquid coolant removes the heat from the cold plate. More particularly, the 
cold plates are each configured to conduct heat from its respective component, and 
are further configured to be convectively cooled by the stream of liquid coolant, 
which flows in to and out of the cold plate without undergoing a state change. 

The stream of liquid coolant is received into the first cold plate 20 1 via a first 
tube 211. Heat from the first cold plate's respective CPU 155 is conductively 
dissipated into the first cold plate. The stream of liquid coolant from the first tube 
211 cools the first cold plate, and convectively removes the CPUs dissipated heat 
from the first cold plate. The stream of liquid, heated by the first cold plate, passes 
through a second tube 213 to be received in the second cold plate 203. 

Heat from the other high-dissipation component 157 is conductively 
dissipated into the second cold plate. The stream of liquid coolant from the second 
tube 2 1 3 cools the second cold plate, and convectively removes the high-dissipation 
component's dissipated heat from the second cold plate. The stream of liquid, 



200311132-1 

10 

heated by the first and second cold plates, passes through a third tube 215 to be 
received in the third cold plate 205. 

Heat from the third cold plate's respective CPU 155 is conductively 
dissipated into the third cold plate. The stream of liquid coolant from the third tube 
215 cools the third cold plate, and convectively removes the dissipated heat from 
the third cold plate. The stream of liquid, heated by the first, second and third cold 
plates, passes through a fourth (and last) tube 217. 

The stream of liquid coolant, having been heated in the first, second and third 
cold plates, passes through the fourth tube 217 to be received by a heat exchanger 
221 . The heat exchanger can be any of a plurality of types, and may define one or 
more passageways 223 that are thermally connected to a plurality of cooling fins 
225. The passageways are configured to dissipate heat from the stream of liquid 
coolant to the fins, and thereby cool the liquid coolant as it passes through the heat 
exchanger. This cooled stream of liquid coolant exits the heat exchanger through 
the first tube 2 1 1 and passes back toward the first cold plate 20 1 . The passageways 
223 and fins 225 are sized and configured to adequately dissipate the heat 
convectively removed from the CPUs 155, the other high-dissipation component 
157, and their respective cold plates, by the coolant. 

A small, mechanical coolant pump 226 is used to pump coolant such that it 
circulates around the cooling system. The pump is a separate device, but could be 
integral with another component of the system, such as the heat exchanger and/or 
the cold plates. The pump could optionally be located at various positions 
throughout the liquid loop of the cooling system. The pump, the coolant, the cold 
plates, the heat exchanger, and the connecting tubes form a closed-loop cooling 
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system that cools each component having high heat-dissipation requirements in 
series. 

The cooling fins 225 of the heat exchanger are positioned in the upstream 
chamber 181, next to an intake side of the bank of chamber fans. The bank of 
chamber fans thus serves as an air mover configured to draw air through the fins. 
The air drawn through the fins is heated by the fins, thereby dissipating the fins' 
heat and cooling the heat exchanger (and the coolant contained inside the heat 
exchanger passageways 223). 



Alternatively, the cooling fins of the heat exchanger could be positioned in 
the downstream chamber, downstream of the bank of chamber fans. The fans 
would then blow across and through the heat exchanger. In either case, the bank 
of chamber fans thus serves as an air mover configured to draw air through the fins. 
1 5 Also, in either case it may be preferable to provide a small space between the bank 
of chamber fans and the heat exchanger, thus forming a plenum. Ducting would be 
provided to assure that essentially all of the blown air passes through the fins (either 
before or after passing through the bank of fans). This plenum may provide for 
more evenly distributed airflow through the fins. 

20 

The bank of cooling fans 175 blows across the downstream chamber 183, 
which contains the memory cards 151, the I/O units 153, the plurality of CPUs 155, 
the other high-dissipation component 157, and the moderate heat-dissipation 
components 159, as well as any other components that require any significant 
25 cooling. Preferably, all cards in the downstream chamber (such as the memory 
cards), and the fins of all heat sinks 161 in the downstream chamber, are aligned 
with airstreams 227 (see, FIGS. 2 and 6) blowing from the bank of cooling chamber 
fans 175 so as to directly receive those airstreams, or at least directly receive 
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airflow caused by those airstreams, without causing an unnecessary impediment. 
The airstreams and/or airflow can then provide some cooling to cards and 
components in the downstream chamber. 

As a result of the above-described configuration, the high-dissipation 
components, including the CPUs, are convectively cooled by a liquid coolant, with 
their heat being dissipated by air drawn from the upstream chamber 181. Most of 
the components in the downstream chamber 183 are cooled by air from the 
upstream chamber moving through the downstream chamber, and most of those are 
cooled by being directly blown upon with air from the upstream chamber by the 
bank of cooling fans 175. The power supply 149 is separately cooled using air 
drawn from the upstream chamber. All components in the upstream chamber are 
preferably cooled by air drawn by or through the components due to the lower 
pressure in the upstream chamber. 

Advantageously, the modular rack 103 can typically also house chassis 
lacking any type of liquid cooling. Additionally the modular rack might also house 
chassis including a closed-loop, evaporative cooling system, as described in U.S. 
patent application serial number 10/772,115, filed February 3, 2004 ("the 
evaporative cooling system"), which is incorporated herein by reference for all 
purposes. 

In some cases, specific designs of the above-described embodiments might 
be constrained such that the heat-exchangers and/or air movers cannot, or 
preferably would not, extend integrally, and/or extend substantially or entirely 
across the chassis. Therefore, variations of these embodiments may be designed 
with additional features that accommodate such preferences. 
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A first variation of this embodiment is provided with a heat exchanger 
having separate first and second heat-exchanger portions. The passageways of the 
first and second heat-exchanger portions may directly connect via a tube. 
Alternatively, the first and second heat-exchanger portions might be situated in 

5 different portions of the liquid-loop, each heat-exchanger portion having 
passageways that are separated from the passageways of the other, on both ends of 
the passageways, by one or more cooling devices (such as cold plates or 
evaporative cooling devices) configured to cool components having high- 
dissipation requirements. For example, with reference to FIG. 7, a first variation 

10 of the first embodiment might include a first cold plate 251, a second cold plate 
253, a third cold plate 255 and a fourth cold plate 257, along with a first heat- 
exchanger portion 259 and a second heat- exchanger portion 26 1 . Passageways 263 
through the first heat-exchanger portion are separated from passageways 265 
through the second heat-exchanger portion by the first, second and third cold plates 

1 5 and one end of the passageways, and by the fourth cold plate at the other end of the 
passageways. 

A second variation of this embodiment is configured with cold plates 
arranged in a parallel configuration. This feature would typically have lower flow 
20 rates through each such parallel cold plate, but would provide each such cold plate 
to operate with substantially the same inlet temperature. Also, the flow resistance 
would be lower, potentially allowing for greater coolant flux and greater heat 
transfer for a given pump operating at a given power level, and/or allowing for 
lower pump power requirements. 

25 

A third variation of this embodiment is further configured with a reservoir 
in the liquid loop. The reservoir could be immediately prior to the pump along the 
coolant flow pat, and could be integral with another component of the system, such 
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as the pump or the heat exchanger. Among other functions, the reservoir can be 
configured such that it serves to remove any air bubbles or contaminants from the 
coolant flow path, thereby increasing the system fault tolerance. 

With reference to FIG. 8, a second embodiment of the invention is an 
apparatus forming a tiered structure, including a multi-tiered support that is 
configured to hold a plurality of computer chassis including depicted chassis 301. 
Similar to the first embodiment, the multi-tiered support defines a longitudinal 
dimension, and is preferably a conventional modular rack configured for a plurality 
of 1U servers. The chassis 301 preferably has a top end and opposite bottom end, 
a front side 303 and opposite rear side 305, and a left side 307 and opposite right 
side 309. 

The chassis 301 is preferably provided with a PCB bottom panel 321 to 
support and/or interconnect one or more electronic assemblies, including drives 
323, a power supply 325, cards 327, and a plurality of computer components 
including a plurality of CPUs and other high-dissipation components such as a 
power converter. The power supply adjoins the right and rear sides of the chassis. 
The plurality of computer components also include some moderate heat-dissipation 
components, some of which could be fitted with heat sinks. 

The chassis and its electronic assemblies are also configured with a cooling 
system to dissipate heat from the electronic assemblies requiring heat dissipation. 
More particularly, the chassis front side 303 defines an intake air vent 341 near one 
side (e.g., the right side 309), and the chassis rear side 305 defines exhaust air vents 
(similar to the first embodiment). The chassis is provided with a high-volume air 
mover 343. Additionally, the power supply 325 has dedicated intake fans 345 and 
exhaust fans (not shown). 
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The chassis might include additional region-specific fans, such as one or 
more flow guide fans 347, and one or more card-cooling fans 349. These region- 
specific fans provide additional control over regional airflow, so as to provide 
adequate cooling throughout all regions requiring such cooling. Additional flow 
5 control can also come from flow guide partitions 350, which can be placed adjacent 
to the intake or outlet sides of the fans or the blower to better control air movement 
within the chassis. All of the fans preferably blow in a rearward direction, but other 
configurations might be appropriate for particular regional needs within the chassis. 

The air mover 343 is preferably a low-profile, centrifugal blower that axially 
receives air that was received from the intake vent via an intake manifold 351, and 
that expels it in a circumferential direction. More particularly, the air enters the 
intake manifold from the intake vent, and then flows substantially under the blower. 
From the manifold, the air flows axially up or down into a center portion of the air 
mover in the longitudinal dimension 105, which is normal to the primary plane of 
the chassis. The air mover is configured to blow in a crosswise direction 353 (e.g., 
at substantially a right angle) to an exhaust direction 355 (i.e., a direction normal 
to the side defining the outlet vents, which is the rear side 305 as depicted). As a 
result, the cross-blown air is blown in a direction substantially parallel to side 
defining the outlet vents. 

The crosswise direction 353 is also at a substantially right angle to an intake 
vent entry direction (i.e., a direction normal to the side defining the intake vent 34 1 , 
which is the front side 303 as depicted), such that the cross-blown air is blown in 
25 a direction is parallel to side defining the intake vent. The crossblown air is stopped 
by the opposite side wall, and turns toward the exhaust vents. As a result of the 
crosswise flow of the cross-blown air, the region of the chassis into which the air 
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is directly blown acts as a plenum, turning and distributing the air through the 
remaining portion of the chassis between the plenum and the exhaust vents. 

The high- volume air mover 343 preferably provides for efficient heat transfer 
5 using a heat exchanger 361 that is located next to the air mover in the path of the 
blown air, and that preferably does not extend across the full width of the chassis. 
This configuration provides for various types of chassis architecture, while limiting 
cooling dead zones (areas having little airflow for cooling). Optionally, the liquid- 
cooled components are located in the primary locations having limited airflow for 
10 cooling. 

Preferably, the air mover 343 is positioned such that all significantly air- 
cooled components (i.e., all components that requiring cooling by more than 
relatively stagnant air, and that are not cooled using the liquid loop), are either 
15 positioned directly within a cross-blown zone defined by the relatively linear, 
crosswise path of the cross-blown air, are cooled by region specific fans, and/or are 
positioned in the region between the cross-blown zone and the outlet vents. This 
region between the cross-blown zone and the outlet vents will typically have 
significant airflow toward the outlet vents. 

20 

Furthermore, preferably the power supply 325 is located between the air 
mover 343 and the side defining the outlet vents, which will typically limit the 
development of cooling dead zones. The power supply 325 is preferably fully 
enclosed such that the dedicated intake fans 345 and exhaust fans control and direct 
25 all the cooling airflow through the power supply. The intake fans draw air from 
within the chassis chamber, and the power supply exhaust vents vent air through the 
rear side 305 of the chassis, thus preventing the hot air from the power supply from 
reaching other portions of the chassis. 
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Similar to the first embodiment, the second embodiment includes a pump 
371, cold plates (e.g., CPU cold plates 373 on the CPUs, and other-device cold 
plates 375 on the power converter), tubes 377 and any other components necessary 
for a liquid-loop cooling system. Like the first-described embodiment, modular 
5 racks configured for this embodiment might also receive typical air-cooled chassis, 
as well as receive chassis that are configured with an evaporative cooling system 
as incorporated above by reference. 

A second variation, which is applicable to the first or second embodiments, 
may be similar to the first or second embodiments in many features. This variation 
differs in that rather than (or supplemental to) drawing in ambient air to cool 
components, a source of chilled fluid such as air or another gaseous fluid (or 
conceivably even a liquid fluid for an appropriate application) is in fluid 
communication with the chassis, preferably via passageways within the rack. The 
chilled fluid preferably enters the upstream chamber of the first embodiment, or the 
air mover intake manifold of the second embodiment, so as to pass through the heat 
exchanger. Similar to as noted above, modular racks configured for embodiments 
of this variation might also receive typical air-cooled chassis, as well as receive 
similarly configured chassis (e.g., chassis configured to receive chilled air from a 
rack) that lack any type of liquid cooling, or that are configured with an evaporative 
cooling system as incorporated above by reference. 

In some additional variations of the first or second embodiments, the air- 
cooled heat exchanger could be replaced with a heat exchanger of other design. For 
25 example, in a third variation, the heat exchanger could be cooled with a liquid. The 
liquid would preferably enter and exit the chassis through tubes and chassis 
connection ports that connect up to rack connection ports on the modular rack, the 
chassis and rack ports preferably connecting automatically upon the insertion of the 



10 



15 



20 



200311132-1 

18 

chassis into the rack. The modular rack could be configured with rack ports for 
chassis located in each chassis-position within the rack. The rack ports are 
configured with lines forming liquid passageways connecting the various chassis 
in the rack into a rack liquid loop, either in parallel (typically for efficient cooling) 
5 and/or in series (typically to limit cost and space requirements). 

The modular rack liquid loop could include a heat sink that is external to the 
plurality of chassis, and possibly external to the rack. The heat sink is preferably 
configured to dissipate heat from all the chassis connected into the rack liquid loop. 

1 0 The rack liquid loop could be exclusive to the modular rack, or it could encompass 
a plurality of modular racks interconnected in series and/or in parallel. Similar to 
as noted above with regard to the first- and second-described embodiments, 
modular racks configured for these embodiments might also receive typical air- 
cooled chassis, as well as receive similarly configured chassis (e.g., chassis 

1 5 configured with a liquid-cooled heat exchanger) with an evaporative cooling system 
as incorporated above by reference. 

A fourth variation is similar to the third, except that a rack having a closed 
liquid loop is not used. More particularly, the heat sink is replaced with an endless 

20 supply of liquid (e.g., a water line) and a liquid exhaust for disposing of heated 
liquid. Like the first- and second-described embodiments, modular racks 
configured for this variation might also receive typical air-cooled chassis, as well 
as receive similarly configured chassis (e.g., chassis configured with a liquid-cooled 
heat exchanger) with an evaporative cooling system as incorporated above by 

25 reference. 

A fifth variation is also similar to the third, except that the heat exchanger is 
cooled with a refrigerant. More particularly, the heat exchanger is configured to be 
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evaporatively cooled by refrigerant that is in turn re-condensed in an external heat 
exchanger external to the chassis, and possible external to the rack (similar to the 
heat sink of the second variation). Like the first- and second-described 
embodiments, modular racks configured for this variation might also receive typical 
5 air-cooled chassis, as well as receive similarly configured chassis (e.g., chassis 
configured with a refrigerant-cooled heat exchanger) with an evaporative cooling 
system as incorporated above by reference. 

A sixth and seventh variation of the first and second embodiments are similar 
10 to the fifth, except that the chassis heat exchanger is eliminated. Instead, the 
coolant tubes directly connect the chassis cold plates to chassis ports, which place 
the cold plates in fluid communication with either an external heat exchanger (in 
the fifth variation) that is external to the chassis, and possibly external to the rack, 
or to an endless supply of coolant (in the sixth variation). Like the first- and 
1 5 second-described embodiments, modular racks configured for these embodiments 
might also receive typical air-cooled chassis, as well as receive similarly configured 
chassis (e.g., chassis lacking a heat exchanger) with an evaporative cooling system 
as incorporated above by reference. 

20 As appropriate, a modular rack might be configured for multiple types of the 

above-described chassis. Additionally, the fourth through seventh variations, like 
the third variation, can be configured for multiple racks to be interconnected within 
a single cooling system. 

25 An eighth variation, which is applicable to above-described embodiments 

and variations, may be similar to the first or second embodiments in many features. 
As depicted in FIG. 9, some or all of the components cooled by the cold plates are 
covered by a component cover 40 1 . Airflow 403 from blowers 405, flow guide fans 
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407 and flow guide partitions 409 pass over the cover. The cover limits 
disturbance of the airflow over the cold plates and the cooled components, and also 
limits the heating of the airflow passing over the components by the components 
and cold plates. 

A ninth variation, which is applicable to above-described embodiments and 
variations, may be similar to the first or second embodiments in many features. 
This variation includes a control system configured to control the level of cooling 
provided to the components cooled by the cold plates, and/or to the air-cooled 
components. Optionally, the control system can be configured to control the 
operating power levels of the air mover, of the fans and other air-movement 
devices, and/or of the pump, so as to control level of cooling. 

Furthermore, for cold plates arranged in parallel, the tubing optionally can 
be configured with valves or supplementary pumps such that the rate of rate of flow 
between parallel branches of the cooling system can be separately and individually 
controlled. The control system is thus configured to control the relative rate of 
coolant flow to the parallel cold plates (and their respective components). As a 
result, the cooling system can be operated at the lowest power level necessary to 
deliver adequate cooling to each heat-critical component. 

The control system of the ninth variation can be configured to operate based 
on any available indices of component cooling requirements. Such indicia could 
include component usage levels, component internal sensors, and external sensors 
configured for sensing the component cooling needs (e.g., temperature). 
Furthermore, the control system can be provided in hardware and/or software 
within the chassis, and/or it can be partially or totally external to the chassis. In the 
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later case, it can optionally be configured to control the cooling of components 
within a number of chassis. 

While the depicted enclosure of the first embodiment appeared as a unitary 
5 rack with laterally inserted chassis, it is to be understood that other configurations, 
such as modular structures that can be modularly disassembled, are within the scope 
of the invention. For example, each chassis could be configured as a stackable 
module with connectors that provide electrical and electronic connections for other 
chassis in the stack, allowing for a structure of configurable longitudinal height. 

10 

While providing good heat-removal characteristics, the apparatus is 
preferably configured with features known for typical rackmount enclosures, 
providing shock, vibration and/or dust protection. For example, the external 
openings (e.g., the vents) are preferably well shielded from the components, 
1 5 providing good shielding against electromagnetic radiation. 

It is to be understood that the invention comprises apparatus and related 
methods for designing and for producing cooling enclosures, as well as the 
apparatus and cooling methods of the enclosures themselves. Additionally, various 
20 embodiments of the invention can incorporate various combinations of the above 
described embodiment features (e.g., a mechanical coolant pump could be used in 
a cooling system where the cold plates are connected in parallel). In short, the 
above disclosed features can be combined in a wide variety of configurations within 
the anticipated scope of the invention. 



While particular forms of the invention have been illustrated and described, 
it will be apparent that various modifications can be made without departing from 
the spirit and scope of the invention. For example, while typical electronic 
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computer components have been described, the cooling of other components such 
as optical devices and the like are within the scope of the invention. Thus, although 
the invention has been described in detail with reference only to the preferred 
embodiments, those having ordinary skill in the art will appreciate that various 
modifications can be made without departing from the scope of the invention. 
Accordingly, the invention is not intended to be limited by the above discussion, 
and is defined with reference to the following claims. 



